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ABSTRACT 

Four different observational systems and two time 
sequences were employed to determine the extent to which they would 
yield different incidences of anti-social behavior. Two videotapes^^ 
randomly chosen from a pool of 30 tapes, were utilized. These 
illustrated the behaviors of anti^social children in a natural 
setting. Six observers were reliably trained in the observational 
systems. Observers, systems, time sequences, and tapes were assigned 
randomly and counter-balanced, thus providing for a within 
experimental replication. The results of the experiment indicate no 
significant differences for time sequences or observational systems. 
The results are discussed briefly in terms of their significance for 
time sampling methods used in behavioral analyses, (Author) 
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ABSTRACT 

Four different observational systems and two tine sequences were 
employed to determin^e the extent to which they would yield different 
incidences of anti-social behavior-, Two videotapes, randomly chosen 
from a pool of 30 tapes, were utilized. These illustrated the behaviors 
of anti-social children in a natural setting. Six observers were reli- 
ably trained in the observational systems. Observers > systems^ tir^ 
sequences, and tapes were assigned randomly and counter-balanced, thus 
providing for a within experimental replication. The results of the 
experiment indicate no significant differences for time sequences or 
observational systems. The results are discussed briefly in terms of 
their significance for time sampling methods used in behavioral analyses. 



Int ro duct ion 

Behavior modification practice is based on three essential procedure:?: 
(l) The analysis of target behaviors chosen for modification in terms of 
observable events; {?.) Definition of the behaviors in a manner that enables two 
persons to consistently agree that the selected behavior has occurred; and (3) 
The systematic collection of data to determine if selected antecedent or conse- 
quent behaviors significantly influence the rate of the behavior chosen for 
modification (Baer^ Wolf, and Risleyj I968; Bijou, Peterson, Harris, Allen, and 
Johnston, 1969; Bijou, 1970). 

In the last decade implementation of these procedures has been facilitated 
through the introduction of significant methodological advances in the measure- 
ment of social behavior, particularly the behavior of autistic, hyperactive, 
anti-social, and retarded children (Cohen and Filipczak, 1971; Browning and Stover, 
I97I; Graziano, 1971; Hamblin , ' Buckholdt , Kerritor, Kozloff, and Blackwell , 1971; 
Tharp and Wetzel, 1969). Howeve**, little attention has been given to the question 
of whether or not different types of measurement systems or time sequences, e.g* , 
securing more observations on a child, differentialJy influence the- frequency of 
behaviors, observed and, therefore, the conclusions derived by investigators. 

^orae recent research indicates that differential observer effects take 
place in the recording of behavior. ' For instance, observers rate behaviors 
differently when they are aware of the experimental hypothesis, know that the 
behavior is being simultarieously used by others to assess reliability ratings, 
and so forth.. Likewise, observers' definitions of behavior change over time 
iinless periodic retraining ses3ionr> are held to assure reliable observations* 
(Johnson and Bolstad, 1973; Jones, 1973; O'Leary and Kent, 1973; Romanczyk, Kent, 
Diament, and O'Leary, 1973; Skindrud, 1973). The present investigation seeks to 
evaluate the differential effects, if any, of four different observational systems 
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and two different time sequences on the ratings secured by observers of anti- 
social behavior exhibited by children, 

METHODOLOGY 

Videotapes 

■Pwo videotapes were selected randomly from a pool of 30 tapes which were 
compiled during a larger study. They had been utilized to train non-participant 
observers and had served as training devices for therapists working with groups 
of anti-social children in a community based treatment propirain."^ Children we^e 
referred to the program from various agencies, including a special school dis- 
trict, mental health centers, juvenile courts, children's homes, and so forth. 
To help professionals (e.g., teachers, counselors, psychologists, and social 
workers) refer childi-en to the project the investigators devised a checklist 
illustrating the types of behaviors that a child should exhibit in order to be 
considered for referral. The behaviors denoted on the checklist were analogous 
to those tested on the observational scales used for the study. The two tapes 
depicted children exhibiting anti-social, non-social, and pro-social behavior 
in two activity contexts, finger painting and making model airplanes. Each was 
30 minutes in length. 
l^on-Participant Observers 

Six university students* were trained to use the four observational scales 
until each could reliably rate the children's behavior through the use of other 
tapes not utilized in the present study. The observers were considered trained ' 
when they could agree with the first author and with each other at a .90 level. 
The study lasted for eight 30-rainute experimental sessions, with one session held 
per week. To insure consistency of the behavioral definition throughout the 

"""A detailed explanation of the project is available from the first author upon 
request. 



study, reliability checks on the behavioral definitions were held weekly. In 
addition, one of the four scales was randomly chosen for each session in order 
to secure an additional check on whether the raters used the system reliably 
after the initial training. The following formula yielded a ratio of inter- 
observer agreement interval by interval. 

Number of agreements 

Ratio of inter-observer = ■ 

agreement Number of agreements + number of disagreements 

All of these checks were above ',90, with a mean of .98. 
Observational Systems 

» 

1. System #1 involved rating the following behaviors: pro-social, non- 
social, and anti-social. Observers were instructed to rate the first behavior 
observed at the bepinninf^ of a ten-second, interval . 

2. For system //2 observers were instructed to look at a child for an 
entire ten second interval; if he exhibited any anti-social behavior during the 
ten-second interval the observer was to mark this interval accordingly. Only 
the category of anti-social behavior was used for this system. 

3. For system #3 the observers were to watch the child for each ten- 
second interval and mark all three behaviors (pro-social, non-social, and an,ti- 
social) if they occurred. These could only be marked once per interval. 

i*. For system ffk the observers were to record within each ten-second 
interval all anti-social behavior e^diibited by a* child every time it occurre d. 
Again, like system #2, only the category of anti-social behavior was used. 
Time Sequences 

The two time sequences utilized in the study involved, (a) having one cb=- 
server rate each child in a group on a ten-second rotating basis imtil all five 
children were rated once, and then repeating the process continuously for the 
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duration of the meeting and (b) having one observer rate one of the five children 

in the group on a ten-second basis for the entire session. 

Design 

The design was a 2 x H x 2 factorial where the first factor was designed 
as tapes, the second as observational system^ and the third as time sequence. 
The assignment of tapes, systems, time sequences, and observers to all cells was 
randomly counter-balanced. Since two tapes were utilized the study was repli- 
cated once (Campbell and Stanley, 19b7). Ndne of the observers who participated 
in the study were informed of the hypothesis. It is doubtful that the observers 
could have deduced the hypothesis of the study since they also were securing 
data for the previously mentioned program which maintained a large numiDer of 
hypotheses. The following behavioral definitions were used throughout the entire 
study for pro-social, non-social, and anti-social behavior. Only the general 
definitions of pro-social and non-social behavior are provided since the major 
interest was anti-social behavior.^ 
Behavioral Categories | 

Pro^social behavior generally was defined as any behavior directed toward 
completion of the group task or toward participation in the group activity. Non- 
social behavior was defined as behavior not directed toward completion of the 
group task but which did not interfere with another child's participation in the 
group task or activity. Anti-soci al behavior was defined as any behavior exhib- 
ited by a group member which prevented the other group menibers from participating 
in the group task or activity. The following behavioral descriptions were used 
in the initial training and then for the actual observation of anti-social 
behavior. 

^Specific behaviors used in the definition of pro-social and non-social behavior 
are available from the first author upon request. 
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Mti-social behavior is indicated when the follwing behaviors occur: 

(a) Verbalizations : A child talks to ajiother child and thus disrupts 
the latter's participation in the group activity; a child talks io another child 
and thus disrupts someone else who is trying to participate in the group activity; 
a child speaks without directing the conversation toward anyone; a child enf^ages 
in name-calling, crying, screaming loud, laughing, coughing, disruptive singing, 
disruptive whistling, and so forth # 

(b) Gross Motor Behaviors : If the children are seated around the table 
or in a circle but the child is out of seat or position without the therapist's 
pernussion,' or if he is running, jumping, skipping, standing up, hopping, moving 
a chair, or walking around aimlessly, thus disrupting the group activities, 

(c) Qb.iect Interference : A child plays with some object that inter- 
feres with another child's participation in the group, e.g., taps a pejicil on 
the tal)le or slams things on furniture. 

I ' 

(d) Physical Contacts : Contact is initiated by one child toward an- ' 
other who is parti ciparoing in the group activity, 'Phis contact disrupts the 
latter child*3 participation. The contact may include hitting, kicking, shoving, 
pinching, slapping, striking with an object, throwing an object which hits an- 
other person, pokingwith an object, biting, pulling hair, patting, touching, 

or disturbing another child's property. 

(e) D istracting^ Behaviors : A child engages In physical movement that 

I 

attracts another child's attention and causes the latter to stop participating 
in the group activity. The former child may turn his head or body to look at 
another child, show an object to another child, rock in a chair, sit out of 
position, clean or ruimnage in furniture, and so forth. 
* ^ RESULTS 
. The data for Tape 1 (see Figure l) suggest that the different observational 
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Insert Fip:ure 1 about here 
systems and time sequences do yield different estimates of anti-social behavior; 
however, the differences are statistically non-significant. The data represent 
the mean of unti-social behavior tabulated by averaging all the obi^ervations that 
each observer made while watching one child or watching all the cliildren on a 
rotating basis* The specific data were as follows for Observation System I (OSl) 
according to watching all the children (AC) 13.0^4/^ and an observer watching one 
child (OC) 9.30^; OSII: AC, 17.86^, OC, 13. ^^8^^; OSIII : AC, l6.,27^, OC, l6.27/^; 
OSIV: AC, 7.23$to, OC, 13.hQ%. 

Likewise, the data in Figui'e 2, for Tape 2, show the same pattern. Again 

Insert PUfiure 2 about here 
it is evident that different observational systems yield varying incidences of 
anti-social behavior, but again the differences are non-significant. The specific 
data were as follows for Observation System I (OSl) according to watching all the 
children (AC) 21.27% and an observer watching one child (OC) lQ.Qk%i OSII: AC, 
29. 08:^, OC, 20.10%; OSIII: AC, 17.28;i, OC, 17.^^:^; OSIV: AC, 13*97;^, OC, 20. 77/^. 
It is interesting to note that in the data for system #3 the time sequence varia^ 
tion did not account for a great deal of the variance in either tape. However, 
in' the other systems the time sequence used to secure the data (e.g,, having one 
observer view each child or having an observer view the whole group on a rotating ^ 
basis) did make somewhat of a difference. Likewise, the data reported in both 
figures suggest that system ffk^ having an observer mark all acts of anti-social 
behavior while watching the five childi*en on a rotating basis, reduces the re- 
corded rate of anti-social behavior. This lost data inight be. attributable to 
the recording procedure wherein the observer tallies an anti-social behavior 
each time it occurs. Thus, anti-social behavior that occurs while the observer 
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is recording may not be observed. To eliminate this possible data loss each 

J 

child might be observed for the entire ten-second interval aiid then the observer 
might take five seconds to record the number of anti-social behaviors observed. 
An arcsin transformation of the percentage data was carried out in order 
to meet the various assumptions required to perform an analysis of variance 
assessing the effects of tape, observational system, and time sequences (v;ike, 
1971). The results are shown in Table 1. The tests* of significance show no 

Insert Table 1 about here 
significant difference- between observational systems and tine sequences. The 
amount of anti-social behavior on Tape 2 was greater than that on Tape 1. 
However, since there were no significant interactions the findings are not 
affected. 

DISCUSSION 

The original hypothesis was that the different tiir»e sequences and obser- 
vational systems studied would differentially affect the data collected by non- 
participant observers. However, the hypothesis was not supported. The variations 
that occurred between systems and time sequences were not significantly different. 
Thus, the investigation provides support for the assumption that random time 
sampling procedures nullify differences in observational format and the timing 
of observations. The former are based on securing proportionate samplings of 
behavioral data that are representative of the total incidence of jsuch behavior 
expected for the children within a given social context. If reliable, differing 
data gathering systems are likely to yield essentially the same data. The selec- 
tion of an observational system for an empirical study should depend on its con- 
ceptual relationship with the purposes of the research. The data reported in 
Figures 1 and 2 indicate that there art slight variations in data secured 
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according to different types of observational systems and time sequences. Con- 
sequently, before data are secured for a study, a pilot test of various observa- 
tional systems and time sequences contemplated for use vould help to assess 
whether or not the resulting differences vould be substantial enough to affect 
the various hypotheses being tested. 
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